|
In mathematical optimization, the method of Lagrange multipliers (named after Joseph Louis Lagrange〔Mécanique Analytique sect. IV, 2 vols. Paris, 1811 https://archive.org/details/mcaniqueanalyt01lagr〕) is a strategy for finding the local maxima and minima of a function subject to equality constraints. For instance (see Figure 1), consider the optimization problem :maximize :subject to . We need both and to have continuous first partial derivatives. We introduce a new variable () called a Lagrange multiplier and study the Lagrange function (or Lagrangian) defined by : where the term may be either added or subtracted. If is a maximum of for the original constrained problem, then there exists such that is a stationary point for the Lagrange function (stationary points are those points where the partial derivatives of are zero). However, not all stationary points yield a solution of the original problem. Thus, the method of Lagrange multipliers yields a necessary condition for optimality in constrained problems.〔.〕〔 * * 〕〔 〕 Sufficient conditions for a minimum or maximum also exist. ==Introduction== One of the most common problems in calculus is that of finding maxima or minima (in general, "extrema") of a function, but it is often difficult to find a closed form for the function being extremized. Such difficulties often arise when one wishes to maximize or minimize a function subject to fixed outside conditions or constraints. The method of Lagrange multipliers is a powerful tool for solving this class of problems without the need to explicitly solve the conditions and use them to eliminate extra variables. Consider the two-dimensional problem introduced above: :maximize :subject to . The method of Lagrange multipliers relies on the intuition that cannot be increasing at a maximum in the direction of any neighboring point where . If it were, we could walk along to get higher, meaning that the starting point wasn't actually the maximum. We can visualize contours of given by for various values of , and the contour of given by . Suppose we walk along the contour line with . We are interested in finding points where does not change as we walk, since these points might be maxima. There are two ways this could happen: First, we could be following a contour line of , since by definition does not change as we walk along its contour lines. This would mean that the contour lines of and are parallel here. The second possibility is that we have reached a "level" part of , meaning that does not change in any direction. To check the first possibility, notice that since the gradient of a function is perpendicular to the contour lines, the contour lines of and are parallel if and only if the gradients of and are parallel. Thus we want points where and :, for some where : are the respective gradients. The constant is required because although the two gradient vectors are parallel, the magnitudes of the gradient vectors are generally not equal. (The negative is traditional). This constant is called the Lagrange multiplier. Notice that this method also solves the second possibility: if is level, then its gradient is zero, and setting is a solution regardless of . To incorporate these conditions into one equation, we introduce an auxiliary function : and solve : This is the method of Lagrange multipliers. Note that implies . The constrained extrema of are ''critical points'' of the Lagrangian , but they are not necessarily ''local extrema'' of (see Example 2 below). One may reformulate the Lagrangian as a Hamiltonian, in which case the solutions are local minima for the Hamiltonian. This is done in optimal control theory, in the form of Pontryagin's minimum principle. The fact that solutions of the Lagrangian are not necessarily extrema also poses difficulties for numerical optimization. This can be addressed by computing the ''magnitude'' of the gradient, as the zeros of the magnitude are necessarily local minima, as illustrated in the numerical optimization example. 抄文引用元・出典: フリー百科事典『 ウィキペディア(Wikipedia)』 ■ウィキペディアで「Lagrange multiplier」の詳細全文を読む スポンサード リンク
|